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Abstract 


This  paper  extends  the  theory  of  median,  order-statistic  (OS),  and  stack  filters 
by  using  mathematical  morphology  to  analyze  them  and  by  relating  them  to  those 
morphological  erosions,  dilations,  openings,  closings,  and  open-closings  that  commute 
with  thresholding.  The  max-min  representation  of  OS  filters  is  introduced  by  showing 
that  any  median  or  other  OS  filter  is  equal  to  a  maximum  of  erosions  (moving  local 
minima)  and  also  to  a  minimum  of  dilations' (moving  local  maxima).  Thus,  OS  filters 
can  be  computed  by  a  closed  formula  that  involves  a  max-min  on  prespecified  sets  of 
numbers  and  no  sorting.  Stack  filters  are  established  as  the  class  of  filters  that  are 
composed  exactly  of  a  finite  number  of  max-min  operations. 

The  kernels  of  median,  OS,  and  stack  filters  are  collections  of  input  signals  that 
uniquely  represent  these  filters  due  to  their  translation-invariance.  The  max-min  func¬ 
tional  definitions  of  these  nonlinear  filters  is  shown  to  be  equivalent  to  a  maximum  of 
erosions  by  minimal  (with  respect  to  a  signal  ordering)  kernel  elements,  and  also  to  a 
minimum  of  dilations  by  minimal  kernel  elements  of  dual  filters.  The  representation  of 
stack  filters  based  on  their  minimal  kernel  elements  is  proven  to  be  equivalent  to  their 
representation  based  on  irreducible  sum-of-products  expressions  of  Boolean  functions. 

It  is  also  shown  that  median  filtering  (and  its  iterations)  of  any  signal  by  convex  1-D 
windows  is  bounded  below  by  openings  and  above  by  closings;  a  signal  is  a  root  (fixed 
point)  of  the  median  iff  it  is  a  root  of  both  an  opening  and  a  closing;  the  open-closing 
and  clos-opening  yield  median  roots  in  one  pass,  suppress  impulse  noise  similarly  to 
the  median,  can  discriminate  between  positive  and  negative  noise  impulses,  and  are 
computationally  less  complex  than  the  median.  Some  similar  results  are  obtained  for 
2-D  median  filtering. 
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1  INTRODUCTION 

Median  filters  and  their  generalization,  order-statistic  (in  short,  OS)1  filters,  are  a  class 
of  nonlinear  and  translation-invariant  discrete  filters  that  have  become  popular  in  digital 
speech  and  image  processing,  and  also  in  statistical  or  economic  time  series  analysis.  These 
filters  are  attractive  because  they  are  easy  to  implement  and  can  suppress  impulse  noise 2 
while  preserving  the  edges  of  the  signal.  This  is  in  contrast  to  linear  filters,  which  blur 
edges  and  only  smooth  impulses. 

Tukey  [l]  first  used  the  median  filter  for  nonlinear  smoothing  of  data.  Median  filters 
were  then  used  in  speech  smoothing  [2,3]  and  image  enhancement  [4]-[7] .  Considerable 
interest  and  research  have  been  invested  in  studying  properties  and  fixed  points  (roots) 
of  median  filters  [8]-[l9].  Roots  of  the  median  filter  have  been  used  in  edge  enhancement 
[1,6,7]  and  image  coding  [14].  The  OS  filters  were  studied  in  [8,11,17,21,22]  and  used  for 
AM  signal  detection  and  image  enhancement.  Any  OS  filter  can  be  defined  both  for  binary 
and  for  multilevel  signals.  Moreover,  OS  filters  commute  with  any  monotonic  pointwise 
transformation  of  the  signal  amplitude;  thresholding  at  any  level  is  such  a  monotonic 
transformation.  This  property  of  OS  filters  to  commute  with  thresholding  was  investigated 
independently  in  [23,8,9,7,15,17,24,25,26].  It  was  proven  for  any  cascade  of  min/max  op¬ 
erations  by  Nakagawa  and  Rosenfeld  [23],  appeared  with  examples  in  Justusson  [8],  and 
was  proven  for  the  median  by  Tyan  [9],  who  also  notes  that  a  signal  is  a  median  root  iff 
each  of  its  thesholded  versions  (cross-sections)  is  a  binary  median  root.  Serra  [24]  outlined 
a  procedure  to  prove  that  the  2-D  hexagonal  median  filter  commutes  with  thresholding. 
Serra  also  proved  that  a  signal  can  be  uniquely  decomposed  into  its  cross-sections  and  re¬ 
constructed  from  them  using  a  supremum.  Fitch  et  al. .  [15,17]  provided  a  complete  proof, 
without  using  morphology,  for  the  combined  result  that  median  and  OS  filters  (recursive 
and  nonrecursive)  commute  with  thresholding  and  hence  OS  filtering  of  multilevel  signals 
reduces  to  a  sum  of  OS  filters  for  binary  signals;  their  result  refers  to  signals  with  finite 

1What  we  call  OS  filters  in  this  paper  have  also  been  called  “ranked-order”  operations  in  [11,17];  we  use 
the  name  OS  to  keep  up  with  earlier  literature  [7,8,20]. 

2By  impulse  noise  is  meant  that  a  signal  is  corrupted  by  impulses  (spikes),  i.e.,  very  large  positive  or 
negative  values  of  short  duration;  probabilistic  models  of  impulse  noise  can  be  found  in  [8], 
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extent  and  a  finite  number  of  amplitude  levels.  Wendt  et  al.  [27,28]  defined  the  stack  filters 
as  the  class  of  all  filters  that  are  defined  via  a  finite  window,  commute  with  thresholding 
and,  hence,  are  increasing.  They  made  the  connection  between  stack  filters  and  positive 
Boolean  functions  [29,30,31],  which  have  a  unique  minimal  expression  as  Boolean  sum  of 
products.  Finally,  in  Maragos  &  Schafer  [25]  and  Maragos  [26]  a  unified  approach  was 
introduced  for  representing  a  large  class  of  linear  and  nonlinear  filters  (including  median 
and  OS  filters)  as  a  supremum  of  erosions  or  infimum  of  dilations. 

This  paper,  which  reports  work  from  [25,26],  introduces  the  use  of  mathematical  mor¬ 
phology,  minimal  kernel  elements,  and  concepts  from  Part  1  [32]  to  analyze  median,  OS, 
and  stack  filters  and  to  relate  them  with  morphological  erosions,  dilations,  openings,  and 
closings.  We  emphasize  at  this  point  that  median,  OS,  and  stack  filters  are  related  only 
to  the  function-  and  set-processing  morphological  filters  that  commute  with  thresholding. 
The  general  function-processing  morphological  filters  that  involve  a  non-binary  structur¬ 
ing  function  do  not  commute  with  thresholding,  and  thus  are  not  related  to  median,  OS, 
or  stack  filters.  In  Section  2  we  examine  some  properties  of  OS  filters  and  provide  two 
alternative  simple  proofs  of  the  fact  that  they  commute  with  thresholding.  In  Sections  3,4 
we  show  that:  l)  Any  OS  filter  can  be  exactly  represented  as  a  maximum  of  erosions,  or  as 
a  minimum  of  dilations.  2)  Medians  and  their  iterations  are  bounded  below  by  openings 
and  above  by  closings.  3)  A  signal  is  a  median  root  iff  it  is  a  root  of  both  an  opening  and  a 
closing.  4)  The  open-closing  and  clos-opening  give  us  median  roots  in  a  single  pass,  smooth 
signals  similarly  to  the  median,  and  have  some  advantages  over  the  median.  Some  of  the 
above  results  are  also  valid  for  2-D  signals.  In  Section  5  we  put  result  (l)  in  the  unified 
framework  of  the  theory  of  minimal  elements  [26]  by  introducing  the  kernel  representation 
of  OS  filters.  Finally,  in  Section  6  we  establish  that  stack  filters  is  the  class  of  all  finite 
min-max  and  max-min  operations,  and  we  relate  their  representation  based  on  positive 
Boolean  functions  to  their  representation  based  on  minimal  elements. 

Throughout  this  paper  we  use  the  same  notation,  terminology,  and  concepts  as  in  Part  1 

[32]. 
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2  OS  FILTERS  FOR  SETS  AND  FUNCTIONS 


We  shall  deal  only  with  discrete  OS  filters,  i.e.,  processing  sampled  signals.3  Hence,  our 
functions  (multilevel  signals)  will  be  defined  on  Zm  (m  is  any  positive  integer),  and  our  sets 
(binary  signals)  will  be  subsets  of  Zm.  The  functions  will  generally  have  their  amplitude 
range  in  the  continuum  R.  Let  5  be  a  set  of  n  real  numbers,  where  we  allow  in  S  multiple 
repetitions  of  the  same  element.  Suppose  we  sort  these  n  numbers  in  descending  order 
with  respect  to  their  algebraic  value;  the  A;-th  number  from  this  sorted  list  is  called  the 
A:-th  OS  of  the  finite  set  S,  k  =  1,2, . . .  ,n.  If  n  is  odd,  for  k  —  (n  +  l)/2  we  have  the 
median  of  S. 

Let  W  be  a  window,  which  is  defined  henceforth  as  a  finite  subset  of  Zm  with  |W|  =  n, 
where  |  •  |  denotes  set  cardinality.  The  k-th  OS  of  a  function  f(x)  by  W  is  the  function 

[0S*(/  :  W)](x)  -  k- th  OS  of  {/(y)  :  y  £  Wx}  ,  (l) 

where  x  £  Zm,  1  <  k  <  n,  and  Wx  =  {x  +  a:aGW}  denotes  the  set  W  shifted  at  location 
x.  The  k-th  OS  filter  for  functions  by  W  is  a  function-processing  (FP)  filter  whose  output 
is  the  A;-th  OS  of  the  incoming  function  by  W .  For  k  =  (n  +  l)/2,  whenever  n  is  odd,  we 
have  respectively  the  case  of  the  median  of  a  function  /  by  W,  denoted  as  med(f]W ), 
and  the  median  filter.  If  /  is  a  binary  function,  then  its  fc-th  OS  by  W  is  also  a  binary 
function.  Thus  FP  OS  filters  are  actually  function-  and  set-processing  (FSP)  filters. 

The  straightforward  way  to  define  OS  for  sets  by  a  window  would  be  to  represent  these 
sets  by  their  characteristic  function  and  take  the  OS  of  this  binary  function  by  this  window. 
An  equivalent  set-theoretic  definition  is  the  following.  The  k-th  OS  of  a  set  X  by  W  is 
the  set 

OS*(AT;  W)  —  {y  £  Zm  \  \X  OWv\>  k)  (2) 

where  k  =  1,2, . . . ,  \W\.  Hence,  we  shift  the  window  W ,  locate  it  at  y,  and  count  the  points 
inside  the  intersection  X  n  Wv,  where  X  is  the  input  set.  If  the  number  of  points  is  at 
least  k,  then  the  point  y  belongs  to  the  A;-th  OS  of  X  by  W .  Note  that  \X  D  Wv\  <  n  for 
all  y  £  Zm.  If  n  is  odd  and  k  —  (n  +  l) /2,  then  the  k-th.  OS  of  X  is  called  the  median  of 

3For  a  definition  of  an  analog  median  filter  see  [33]. 
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X  by  W  and  denoted  as  med(X]W).  The  k-th  OS  filter  for  sets  by  W  is  a  set-processing 
(SP)  filter  whose  output  is  the  fc-th  OS  of  the  incoming  set  by  W. 

In  what  follows,  the  term  “OS”,  except  otherwise  stated,  will  always  refer  to  OS  of 
functions  or  sets  by  a  window.  Furthermore,  we  shall  use  interchangeably  the  terms  “OS 
filters  for  signals”  and  “OS  of  signals”.  OS  filters  are  morphological  transformations  of 
signals  by  sets,  because  they  satisfy  all  four  morphological  principles  [24].  Moreover,  the 
window  W  is  actually  a  structuring  element  capable  of  assuming  any  shape  and  finite 
size.  It  need  not  be  a  convex  or  symmetric  set  as  has  been  assumed  so  far  by  previous 
researchers.  Below  we  prove  some  general  properties  of  OS  filters. 

Property  1.  OS  filters  for  sets  and  functions  are  increasing. 

Proof.  Let  X  C  Y.  Then  z  <E  OS*(X  ;  W)  <=>  \X  n  Wz\  >  k.  But,  XnWz  CY  n 
Wz  =►  \xnwz\  <  \YnWz\  =►  2  6  OS*(F;VF).  Hence,  OSk(X; W)C  OS*(y; W).  Now, 
if  /  <  g,  then  f(z)  <  g{z )  \/z  G  Wx,  Vx  €  Zm.  Thus,  [OS k{f;W)\{x)  <  [OS *(/;  W)}{x),  Vx. 
Q.E.D. 

Property  2.  OS  of  functions  commute  with  thresholding.  That  is,  for  any  function  / 
(of  finite  or  infinite  extent)  and  finite  window  W,  for  all  t  6  R  and  k  =  1, 2, . . . ,  |W|, 

X40S*(/;IF)]  =  OSk[Xt{f);W]  .  (3) 

Proof  I.  Let  g(x)  =  [OSfc (/ ;  H/’)](x).  Then,  z  G  Xt(g)  <==>  g(z)  >  t  <=>  \WZ  n 
Xt{f)\>k  <=>  z  e  OSk[Xt{f)-,W}.  Q.E.D. 

Proof  II.  OS  filters  are  FSP  filters  that  are  translation-invariant,  increasing,  and  u.s.c. 
[26].  Hence,  from  Theorem  4  of  Part  1,  they  commute  with  thresholding.  Q.E.D. 

For  the  median  we  simply  have  that  Xt\med{f ;  W)]  =  med[Xt(f)\  W\.  Note  that  Prop¬ 
erty  2  refers  to  any  signal  of  finite  or  infinite  extent  with  a  continuous  or  dicrete  amplitude 
range;  in  [15,17]  the  commuting  with  thresholding  of  OS  filters  was  proved  only  for  the 
special  case  of  signals  with  finite  extent  and  a  finite  number  of  amplitude  levels.  The 
essence  of  Property  2  is  the  equivalence  between  the  OS  filtering  of  a  function  followed 
by  thresholding  at  level  t,  on  the  one  hand,  and,  on  the  other  hand,  the  thresholding  of 
the  function  at  level  t  followed  by  OS  filtering  of  the  resulting  cross-section.  That  is,  both 
ways  should  give  the  same  set,  i.e.,  the  cross-section  of  the  filtered  function  at  level  t.  In 
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addition,  after  having  obtained  all  the  cross-sections  of  OS k{f\W)  via  OS  filtering  of  the 
sets  Xt(f),  we  can  reconstruct  the  filtered  function  by  using  a  supremum  (or  maximum, 
for  a  finite  number  of  amplitude  levels).  Hence,  from  Property  2  and  Part  1  (Theorem  1), 

[OS *(/;  W)](z)  =  sup{t  eR:z&  OS k[Xt(f)-,W]}.  (4) 

In  [15,17,28]  it  is  assumed  that  f(x)  has  only  M  (finite)  amplitude  levels  t ,  and  hence  the 
reconstruction  (4)  can  also  be  done  by  sumpiing  the  characteristic  functions  of  the  sets 
OS*[X*(/);  W]  for  all  M  levels  t.  We  can  transpose  this  result  to  our  case,  where  t  varies 
continuously  over  R,  by  using  integration ;  i.e., 

[OS*(/;IV)]M  =  JR  Xos-wnw W*  (5) 

where  xs  denotes  the  characteristic  function  of  a  set  S  (i.e.,  Xs(z)  =  1  for  z  £  5  and 
Xs{z)  —  0  for  z  $  S).  The  reconstructions  (4)  and  (5)  are  equivalent,  and  both  make  use 
of  the  fact  that  {OS*[X4(/);  W]  :  t  6  R}  is  a  family  of  decreasing  sets  as  t  increases. 
Consequently,  the  analysis  and  implementation  of  OS  filters  can  be  done  by  focusing  only 
on  the  case  of  sets.  Clearly,  OS  of  sets  are  much  easier  to  deal  with  since  their  defini¬ 
tion  involves  only  counting  of  points  instead  of  sorting  numbers  (as  is  the  case  in  OS  of 
functions). 

Let  Xc  denote  the  set  complement  of  X  with  respect  to  Zm. 

Property  3.  OS  of  sets  interact  with  set  complementation  as  follows:  For  any  set  X 
and  finite  set  W,  OS*(Xc;W)  =  [OS"~*+1  (X;W)]C,  for  k  =  1,2, . . . ,  n  =  | W\. 

Proof,  z  e  OSk{Xc;  W)  |XC  n  W,\  >  k  <=>  \X  n  W,\  <  n  -  k  +  1  2  g 

OS n~k+1(X;W)  <=>  ze  [OS n-k+1(X]W)}c.  Q.E.D. 

A  corollary  of  the  above  property,  if  |W|  is  odd,  is 

Property  4.  Median  of  sets  commutes  with  complementation;  i.e.,  med(Xc;W)  = 
[med(X;  W)\c . 
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3  RELATIONS  BETWEEN  OS  AND  MORPHOLOG¬ 


ICAL  FILTERS 

By  combining  the  definitions  of  OS  in  (1) ,(2)  with  the  definitions  of  erosion  and  dilation 
in  Part  1,  we  see  that  the  first  ( k  =  l)  OS  of  any  signal  by  a  window  W  coincides  with 
its  dilation  by  W.  Similarly,  the  n-th  OS,  where  n  =  |W|,  is  equal  to  the  erosion  by  W . 
Hence,  it  can  be  shown  that,  for  k  =  1,2, . . . ,  \W\, 

X  ©  W‘  C  •  •  •  C  OS*+1(X;  W)  C  OS*(X;  W)  C  ■■■  C  X  ®Wa.  (6) 

Thus,  (only)  the  FSP  erosions  and  dilations  by  sets  are  special  cases  of  OS  filters.  Since 
OS  filters  commute  with  thresholding,  relation  (6)  and  all  subsequent  relations  involving 
sets,  OS  or  morphological  filters  for  sets,  and  set  inclusions  are  also  valid  for  functions  too; 
we  only  need  to  replace  sets  with  functions  and  set  inclusion  C  with  function  ordering  <, 
and  vice-versa. 

We  can  interpret  the  k- th  OS  filtering  of  S'  by  a  window  W  as  a  cascade  of  a  linear 
shift-invariant  filter  with  impulse  response  h  =  xw  followed  by  the  nonlinear  pointwise 
thresholding  operation  of  taking  the  cross-section  of  h*  xs  —  Xw  *  Xs  at  level  t  —  k  <  |W|, 
where  *  denotes  linear  convolution.  That  is,  for  all  k  =  1, 2, . . . ,  |W|, 

OSk(S-,W)  =  Xt=k[xw  *  xs}. 

This  formula  allows  us  to  implement  OS  filters  (including  SP  erosion  and  dilation)  in  terms 
of  linear  convolutions;  obviously,  this  is  a  serial  implementation. 

Next  we  show  how  any  OS  filter  can  be  expressed  as  a  maximum  of  erosions  or  minimum 
of  dilations.  Let  =  k{^'_ky  denote  the  number  of  combinations  of  n  items  grouped  k 
at  a  time,  where  0!  =  1. 

THEOREM  1  .  For  any  function  f  and  any  finite  set  W ,  the  k-th  OS  of  f  by  W , 
k  =  1,2,  ...,n  =  \W\,  is  equal  to  the  pointwise  maximum  of  the  moving  local  minima  of 
f  inside  all  windows  equal  to  the  subsets  of  W  containing  exactly  k  points,  and  it  is 
also  equal  to  the  minimum  of  the  moving  local  maxima  of  f  inside  all  the  subsets  of  W 
containing  exactly  n  —  k  +  1  points.  As  a  special  case,  the  median  of  f  by  W  is  equal  to 
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the  maximum  of  minima  (and  also  to  the  minimum  of  maxima)  of  f  inside  all  subsets  of 
W  containing  exactly  (n  +  l)/2  points,  where  n  is  odd. 

Proof.  Let  ak  >  <22  >  •  •  •  >  an  be  the  n  ordered  values  of  /  inside  W  shifted  to  any  location 
z.  Let  Si,  i  =  1,2,...,  (fy ,  be  the  sets  of  values  of  /  on  each  of  all  the  different  subsets  of 
Wz  containing  exactly  k  points.  Since  {ak,. . . ,  a^-i,  a*}  is  one  of  the  S^s,  then  ak  is  one  of 
the  minima  of  /  on  the  5,’s.  Every  other  set  S',-  will  have  at  least  one  element  from  the  set 
{a*+i, ajk+2) •  •  •  > an}  and,  hence,  it  will  have  a  minimum  <  ak.  Thus,  the  maximum  of  all 
these  minima  is  equal  to  ak  =  [OSk(f;  W)](z).  Likewise,  Ti  =  {ak,  ak+k, . . . ,  a„}  is  one  of 

k  + 

n  —  k  +  1  points.  Clearly,  ak  =  max(Ti).  Every  other  set  Tm  ^  Ti  will  have  at  least  one 
element  from  the  set  {ai,  a2, . . .  ,  a*-i}  and,  hence,  it  will  have  a  maximum  >  ak.  Thus, 
the  minimum  of  all  these  maxima  is  again  equal  to  ak.  For  the  case  of  the  median,  n  is  odd 
and  k  —  (n  +  l)/2  =>  k  =  n  —  k  +  1.  Hence,  the  subsets  of  W  with  k  points  are  equal  to 
the  subsets  with  n  —  k  +  1  points.  Thus,  the  minima  and  maxima  refer  to  the  same  subsets 
of  W .  Therefore,  the  median  can  be  expressed  both  as  a  maximum  of  minima  and  as  a 
minimum  of  maxima  on  all  the  subsets  of  W  containing  exactly  (n  +  l)/2  points.  Q.E.D. 

From  Theorem  1  the  following  theorem  immediately  results. 


jJ,  of  the  values  of  /  on  the  subsets  of  Wz  containing 


the  sets  Tm,  m  =  1, 2, . . . ,  (n  ffff 


THEOREM  2  .  The  k-th  OS  of  sets  (resp.  functions)  by  a  window  W,k  =  l,...,n  = 
\W\,  is  equal  to  the  union  (resp.  maximum)  of  erosions  by  all  the  subsets  of  W  containing 
k  points.  It  is  also  equal  to  the  intersection  (resp.  minimum)  of  dilations  by  all  the  subsets 
of  W  containing  n  —  k  +  1  points.  That  is,  for  any  set  S , 

os  k(s-,w)=  yseF-  H  (7) 

PCW  QCW 

|P|=*  |<J|=r»-*  +  l 

For  any  function  f(x),  x  E  Zm,  and  P,  Q  as  in  (7),  we  have 

[OSk(f\W)}{x)  =  ma x{(/  0  P’){x)}  =  min{(/  0  Q*)(x)}  .  (8) 

If  n  is  odd,  for  k  =  (n  +  l)/2  we  have  the  special  case  of  the  median: 

[med(/;  W)](x)  =  max  {(/0B')(i)}=  min  {(/®B’)(i)}  .  (9) 

1  w  B^w  B^w 

|B|=(n+l)/2  |B|  =  (n+l)/2 

The  median  of  S  by  W  is  given  from  (7)  by  setting  k  =  (n  - 1-  l)/2. 
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Proof.  Eq.  (8)  results  from  Theorem  1  and  the  fact  that  the  local  minimum  (maximum) 
filter  with  respect  to  a  moving  window  A  is  equal  to  the  erosion  (dilation)  by  A.  Eq.  (7) 
results  from  (8)  by  setting  S  =  Xt(f)  for  some  t  and  an  arbitrary  function  /,  because 
Xt[OSk{f;W)}  =  OS*(S;  W),  ATt[maxP{/eP4(x)}]  =  U PXt{fQP‘)  =  U PSQPs,  and 
Xt[ming{/©Q4(x)}]  =  fig  Xt{f®Qa )  =  fig  S®Qa.  If  n  is  odd  and  k  =  (n  +  l)/2  =  n  —  k+1 
we  get  (9)  from  (8)  or  (7).  Q.E.D. 

4  MEDIANS,  OPENINGS,  CLOSINGS 

So  far,  our  discussion  has  been  general  and  referred  to  every  OS  by  an  arbitrary  window  W . 
In  this  section  we  discuss  only  the  case  of  median  filtering  by  convex  windows,  because  this 
constraint  enables  us  to  find  some  interesting  properties  between  such  median  filters  and 
openings/closings.  An  intuitive  idea  about  such  properties  can  be  obtained  from  Fig.  1. 
Fig.  la  shows  a  function  /  representing  a  256  x  256-pixel  graytone  image  corrupted  by 
salt-and-pepper  noise.  In  Fig.  lb  the  opening  /g  of  /  by  a  2  x  2-pixel  square  convex 
set  B  cuts  down  the  peaks  of  /  and  hence  suppresses  the  positive  noise  spikes  (“salt” 
noise).  In  Fig.  lc  the  open-closing  (/b)B  fills  up  the  valleys  of  fB  and  hence  suppresses 
the  negative  noise  spikes  (“pepper”  noise).  Comparing  Figs,  lc  and  Id  indicates  that  a 
median  filtering  of  /  by  a  3  x  3-pixel  convex  square  window  W  behaves  similarly  to  the 
open-closing  by  B,  but  the  latter  is  computationally  less  complex  than  the  median.  In 
addition,  the  open-closing  can  decompose  the  noise  suppression  task  into  two  parts;  i.e., 
opening  suppresses  the  positive  noise  impulses,  the  closing  suppresses  the  negative  noise 
impulses,  but  the  median  cannot  discriminate  between  them.  Qualitatively,  the  median 
behaves  like  a  combined  opening  and  closing  by  a  set  of  size  about  half  the  size  of  the 
median  window.  Next  we  formalize  our  discussion. 

4.1  Medians  by  1-D  Convex  Windows 

Assume  in  this  section  that  the  window  for  median  filtering  is  a  convex  symmetric  set 
W  and  that  the  structuring  element  for  openings  and  closings  is  a  convex  set  B,  where 
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W,B C  Z, 


|  W  |=  2n  +  1  ,  |J5|=n  +  l  ,  n  E  Z+  ,  (10) 

and  Z+  is  the  set  of  positive  integers.  The  set  B  does  not  have  to  be  symmetric  or  contain 

the  origin,  because  the  opening  by  B  is  equal  to  the  opening  by  any  translation  Bv  of  B. 

That  is,  XB  =  1J  Ba  a~=+i  (J  (Bv)  b  =  X(B,)  for  any  y  E  Z;  likewise  for  the  closing 
Ba  Cx  (B^Cx 

by  B. 

The  input  signals  to  the  examined  filters  will  be  sets  or  functions,  and,  if  not  otherwise 
stated,  of  finite  or  infinite  extent.  In  proving  the  theoretical  results  of  this  section  we 
assume,  for  simplicity,  that  the  signals  are  1-D.  However,  the  obtained  results  are  also 
valid  for  multi-D  input  signals.  This  is  true  because  we  can  “slice”  (intersect)  a  multi-D 
signal  by  all  1-D  discrete  lines  Z  parallel  to  the  line  containing  the  1-D  median  window  W 
and  essentially  reduce  the  multi-D  filtering  into  1-D  filtering  of  each  1-D  slice. 

A  root  (or  fixed  point )  of  a  filter  ip(-)  is  any  signal  /  such  that  ip(f)  —  f ■  If  is 
FSP  and  commutes  with  thresholding,  then  a  function  /  is  a  function-root  of  ip  iff  all 
the  cross-sections  of  /  are  set-roots  of  xp.  Let  med°k(-;W),  k  e  Z+,  denote  the  k- th 
iteration  of  the  median  filter  by  W,  where  med°^k+1^(f-,W)  =  med[medok{}\  VF);  W]  and 
medol(f]W)  =  med{f\W).  If  /  has  a  finite  extent,  then  iterating  the  median  by  W  on 
/  will  yield  a  median  root,  which  we  denote  by  med°°°{f\W)\  actually,  this  root  will  be 
obtained  after  only  a  finite  number  of  iterations  [10,18]. 

The  ordering  relations  (6)  show  that  the  median  of  a  signal  by  a  window  W  is  bounded 
below  by  its  erosion  and  above  by  its  dilation  by  W .  Below  we  give  tighter  bounds  for  the 
median  and  its  iterations,  and  provide  a  sufficient  condition  to  find  a  median  root. 

THEOREM  3  .  The  median  (and  any  of  its  iterations)  of  any  set  X  or  function  f  by 
W  is  bounded  below  by  the  opening  and  above  by  the  closing  of  the  signal  by  B.  Further, 
if  the  signal  is  a  root  of  the  opening  and  closing  by  B,  it  is  a  root  of  the  median  by  W : 

(a)  XBCmedok{X]W)CXB  and  f B  <  medok(f]W )  <  fB,  \/k  E  Z+. 

(b)  X  =  XB  =  Xs  =►  X  =  med(X]  W)  and  f  =  fB  =  fB  =>  f  =  med(f  ,W). 

Proof.  Let  k  =  1.  Then  z  E  XB  =>  there  is  y  such  that  z  E  BVCX.  From  (10)  and 
since  W  =  W* ,  \  Wz  n  Bv  \>  n  +  1  =H  WznX\>n+l=>zE  med(X\W).  Thus, 
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XBCmed{X\W).  Now  (XC)BC  me<f(Xc;  W)  =>  (XB)CC  [med(X;  W)]c  =>  med(X;  W)C  XB 
The  median  is  increasing  filter.  Hence,  med(XB;  W)C  med°2(X\  W)C  med(XB;  W).  But 
XB  =  {XB)BCmed(XB]W)  and  med(XB\ W)C  (XB)B  =  XB .  Thus  XBC  medo2{X]  W)C  XB , 
and  by  repeating  the  same  procedure  on  the  latter  result  we  obtain  XBC  med°k(X\  W)<Z  XB , 
Vk  £  Z+.  The  FSP  filter  medok(-;W)  commutes  with  thresholding  because  it  is  a  cascade 
of  k  medians.  Thus,  by  setting  in  the  previous  proof  X  =  Xt(f),  it  follows  that  Vi  G  R 
[Xt{f)}BCmedok[Xt{f);W]C[Xt{f)}B  <f=>  Xt{fB)C  Xt[med°k{f-  W)]C  Xt{fB)  <=►  fB  < 
med°k(f]W)  <  fB. 

(b)  is  a  simple  corollary  of  (a)  since  X  =  XBC  med(X;  W)C  XB  =  X  X  = 
med{X\W).  Likewise  for  functions.  Q.E.D. 

Note  that  we  take  the  median  by  IV,  but  the  opening  and  closing  by  B.  From  (10),  the 
set  W  is  a  fixed  point  of  both  the  opening  and  closing  by  B.  Hence,  from  [24],  Xw  C  XB 
and  XB  C  Xw .  Therefore,  if  we  take  the  opening  and  closing  by  W  instead  of  B,  we  will 
bound  the  median  with  looser  bounds. 

By  restricting  the  signal  to  be  of  finite  extent,  we  can  find  a  necessary  and  sufficient 
condition  relating  the  median  roots  to  the  roots  of  the  opening  and  closing.  Gallagher  and 
Wise  [10]  proved  that  a  multilevel  signal  of  finite  length  is  a  median  root  by  a  window  of 
2n  +  1  points  iff  it  consists  of  edges  (monotonic  regions)  and  constant  neighborhoods  of 
at  least  n  -f  1  consecutive  points.  Using  their  method  of  proof,  we  now  prove  a  similar 
theorem  for  sets  (our  approach  differs  in  the  way  we  handle  the  boundary  conditions). 

THEOREM  4  .  A  finite  set  X  is  a  root  of  the  median  by  W,  |W|  =  2n  +  l,  iff  it  consists 
of  convex  subsets  of  length  at  least  n  4-  1  points  and  these  subsets  are  separated  from  each 
other  by  convex  subsets  of  Xc  of  at  least  n  +  1  points. 

Proof.  Sufficiency:  Both  X  and  Xc  consist  of  convex  subsets  of  length  >  n  +  1  =  |H|. 
Hence,  X  —  XB,  and  Xc  =  ( XC)B  <=>  X  —  XB\  thus,  X  =  med{X\W )  due  to  Theorem  3. 

Necessity:  Let  X  =  med(X;  W),  as  shown  below  for  a  set  X  with  W  —  {  —  2,  — 1,0, 1,2}: 

a  b 

i  i 

X  =  ...00  00  1  1  1  1  1  1  1  1  1  0  00  0  1  1  1000...  (11) 

wa  —  wt  — 
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Slide  the  window  W  of  2n  +  1  points  from  left  to  right  (in  (11)  n  —  2).  At  the  first  point 
a  of  X,  the  left  part  of  the  window  Wa  contains  n  points  of  Xc.  Thus,  the  right  part  of 
the  window  Wa  must  contain  n  points  of  X  so  that  a  G  med(X;  W).  Thus,  adjacent  to  the 
point  a  from  the  right  there  is  a  convex  subset  of  X  of  length  k  >  n  +  1  points  (in  (11) 
k  =  9)  including  point  a.  All  these  k  points  will  remain  after  median  filtering.  Moving 
the  window  W  from  left  to  right,  after  this  k- point  subset  of  X ,  we  will  encounter  points 
of  Xc ;  call  b  the  first  such  point.  The  window  W\,  contains  from  the  left  n  points  of  X, 

*”  .4 

and,  hence,  it  must  contain  from  the  right  n  points  of  Xc,  so  that  b  0  med(X;  W).  Thus, 
the  point  b  must  see  from  the  right  a  convex  subset  of  Xc  of  length  j  >  n  +  1  points 
(in  (ll)  j  =  4)  including  point  b.  All  these  j  background  points  will  remain  unchanged 
after  median  filtering.  Continuing  to  the  right  we  may  encounter  another  point  of  X;  by 
repeating  the  above  process,  we  complete  the  proof.  Q.E.D. 

In  the  above  theorem  and  in  all  our  analysis  concerning  OS  filtering,  we  did  not  assume, 
as  in  [10],  that  the  finite  extent  signal  was  extended  by  appending  values  at  the  border 
points.  We  simply  let  the  operation  of  set  complementation  take  care  of  the  border  points. 
That  is,  every  point  outside  the  finite  extent  of  the  set-signal,  belongs  to  the  background. 
Based  on  Theorem  4  we  can  now  relate  the  roots  of  the  median  with  those  of  the  opening 
and  closing,  as  follows. 

THEOREM  5  .  A  set  X  or  Junction  J  of  finite  extent  is  a  root  of  the  median  by  W  iff 
it  is  a  root  of  both  the  opening  and  the  closing  by  B.  That  is,  X  —  med(X;W)  <=>  X  — 
XB  =  Xs,  and  f  =  med(/ ;  W)  <=>  f  =  fB  =  fB . 

Proof,  l)  For  Sets.  Sufficiency  results  from  Theorem  3b.  Necessity :  Let  X  =  med(X;  W). 
Then,  from  Theorem  4,  both  X  and  Xc  consist  of  convex  subsets  of  length  >  n  +  1  =  |£|. 
Hence,  X  =  XB,  and  Xc  =  (XC)B  <=>■  X  —  XB .  2)  For  Functions.  Using  the  links 
between  sets  and  functions  and  the  fact  that  median,  opening,  and  closing  commute  with 
thresholding,  we  have:  /  =  med(/;W)  4=>  Xt(f)  —  Y  —  med(y;W)  Vf  6  R 
Y  =  Yb  =  Yb  <=>  f  =  fB  =  fB.  Q.E.D. 

For  inifinite  signals,  Theorem  3b  is  still  true,  whereas  Theorem  5  is  not  always  true, 
as  the  following  counter-example  shows:  Consider  the  infinite  1-D  set  X  below  and  let 
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B  =  {-1,0,1}.  Then, 


X  =  . . .  01010101.  ..=>  XB  =  ...00000000... 

where  0  (E  Xc  and  1  EX.  Then,  if  W  =  {—2,  —1, 0, 1, 2},  X  —  med(X;  W)  but  X  ^  XB- 
One  implication  of  Theorem  5  is  the  idea  that  instead  of  iterating  a  median  filter  many 
times  to  obtain  a  median  root,  one  could  alternatively  obtain  a  signal  that  is  a  root  of  the 
opening  and  closing;  this  latter  signal  would  then  be  a  median  root.  In  contrast  to  the 
median  filter,  to  obtain  a  root  of  the  opening  or  closing  we  need  not  iterate  the  opening 
or  closing,  respectively,  because  both  operations  are  idempotent.  That  is,  the  opening  or 
closing  of  a  signal  is  itself  a  root  of  the  opening  or  closing  filter,  respectively. 

A  morphological  filter  that  yields  roots  of  both  the  opening  and  closing,  and,  hence, 
of  the  median,  is  the  open-closing  or  clos-opening.  The  open-closing  (opening  followed  by 
closing  by  the  same  structuring  element)  of  X  by  B  is  equal  to  [XB)B  •  The  clos-opening 
(closing  followed  by  opening)  of  X  by  B  is  equal  to  ( XB)B ■  Likewise  for  functions.  Before 
we  prove  the  above  assertion  we  need 

THEOREM  6  .  For  any  set  X  or  function  f  of  finite  extent,  the  root  of  the  median 
by  W  is  bounded  below  by  the  open-closing  and  above  by  the  clos-opening  by  B.  That  is, 
(. Xb)b  C  med000(X;  W)  C  ( XB)B  and  ( fB)B  <  med000(/;^)  <  ( fB)B . 

Proof.  After  a  finite  number,  say  k ,  of  iterations  of  the  median  we  obtain  the  median  root 
Y  =  med°°°(X]  W)  =  med°k(X\W).  Then,  from  Theorem  3,  XB  C7C  XB .  Since  Y  is  a 
median  root,  from  Theorem  5,  Y  —  YB  —  YB .  Thus,  ( XB)B  C  YB  —  Y  —  YB  C  ( Xb)b , 
because  opening  and  closing  are  increasing.  Similarly  for  functions  (by  considering  their 
cross-sections  since  all  the  examined  filters  commute  with  thresholding).  Q.E.D. 

So  far  we  have  seen  that  the  median  is  bounded  by  the  opening  and  closing  and  that 
the  median  root  of  a  finite  signal  is  bounded  by  the  open-closing  and  the  clos-opening. 
Below  we  prove  that  these  two  latter  morphological  filters  are  median  roots  by  themselves. 

THEOREM  7  .  The  open-closing  and  clos-opening  by  B  of  any  finite  extent  function 
f  or  set  X  are  roots  of  the  median  by  W.  That  is,  ( fB)B  =  med[(/s)B; W],  ( fB)B  — 
med[(/B)s;  W\;  likewise,  if  a  set  X  replaces  f. 
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Proof.  From  Theorem  6,  ( fB)B  =  [(/b)b]b  <  med000(fB]  W)  <  [(/b)b]b  <  (/b)b-  Hence, 
(fB)B  =  [(/b)b]b  is  a  root  of  the  opening  and,  obviously,  of  the  closing  by  B.  Thus,  from 
Theorem  3b,  (/b)B  is  a  root  of  the  median  by  W .  Similarly,  (fB)B  is  equal  to  its  opening 
and  closing  by  B  and,  hence,  a  median  root  by  W .  Likewise  for  sets,  if  we  replace  in  the 
previous  proof  /  with  X  and  <  with  C  .  Q.E.D. 

Figure  2a  shows  a  finite  1-D  multilevel  signal  /  of  256  samples  representing  a  gray  tone 

image  intensity  profile.  Figures  2b,c,d  show  respectively  the  open-closing  and  clos-opening 

./ 

of  /  by  B,  and  the  median  root  of  /  by  W,  where  |B|  =  3  and  \W\  —  5.  The  median  root 
was  obtained  by  iterating  the  median  four  times.  The  bounds  of  Theorem  6  are  satisfied, 
but  the  difference  between  the  median  root  and  the  open-closing  or  clos-opening  is  very 
small.  For  a  1-D  signal  of  L  samples,  the  maximum  number  of  iterations  of  the  median 
filter  needed  to  obtain  the  median  root  (with  respect  to  a  2n  +  1-point  window)  is  equal 
to  3 [L  —  2)/(2 n  +  4)  if  we  append  samples  at  the  ends  [18],  and  3L/(2n  +  4)  if  we  do 
not  append  samples  (in  Fig.  2,  L  =  256,  n  =  2).  Further,  for  a  256-sample  signal,  28 
iterations  of  the  median  are  needed  [16],  at  most,  to  obtain  a  signal  which  is  a  median  root 
with  a  confidence  of  95%.  However,  Theorems  6,7  tell  us  that  the  open-closing  and  clos- 
opening  yield  in  one  pass  median  roots,  which  bound  from  below  and  above,  respectively, 
(and,  as  Fig.  2  shows,  lie  close  to)  the  median  root  obtained  by  iterating  the  median. 
As  an  aside,  both  open-closing  and  clos-opening  are  idempotent  operations  [26,32],  and, 
hence,  their  output  stabilizes  in  a  single  pass.  In  addition,  if  we  view  Fig.  2a  as  a  signal 
corrupted  with  impulse  noise  and  Figs.  2b,c,d  as  its  smoothed  versions,  then  clearly  the 
open-closing  (or  clos-opening)  behave  very  similarly  to  the  median.  Moreover,  as  in  Fig.  1, 
the  open-closing  can  selectively  eliminate  positive  or  negative  noise  impulses,  whereas  the 
median  root  cannot  discriminate  them.  In  [34]  the  statistical  properties  of  1-D  and  2-D 
open-closings  (by  a  combination  of  4  oriented  n  +  1-point  1-D  sets)  and  median  filters  (by 
the  same  combination  of  2n  +  1-point  windows)  were  compared;  it  was  found  that  these 
median  filters  offer  more  noise  suppression,  whereas  open-closings  appear  to  have  superior 
syntactical  performance. 

It  may  be  of  interest  to  compare  the  computational  complexity  involved  to  obtain  the 
open-closing  (or,  equivalently,  the  clos-opening)  and  a  median  root.  Recall  that  \W\  = 
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2n  +  1  and  |B|  =  n  +  1.  Then  the  following  three  quantities  are  involved  in  measuring 
the  computational  complexity  (per  output  sample).  The  number  of  passes  P\  the  number 
of  exchanges  E\  and  the  number  of  comparisons  C.  For  the  open-closing  by  B  (two  local 
min  and  two  local  max)  we  have  P  =  4,  E  =  0,  and  C  =  An.  For  a  single  median  filtering 
operation  by  W ,  using  the  bubble-sort  [35]  algorithm  for  sorting,  we  have  1  <  P  <  2n  +  1, 
0  <  E  <  (2 n2  +  n),  and  2 n  <  C  <  (2n2  +  n).  In  addition,  the  average  number  of  these 
three  quantities  required  for  the  median  (i.e.,  for  the  sorting)  is  approximately  [35]  of  the 
following  order:  O(M)  for  Pave,  0(M 2)  for  Eave  and  0(M2)  for  Cave,  where  M  =  2n-fl.  Of 
course,  there  are  other  faster  algorithms  for  sorting  [35]  or  specifically  for  the  median  (see  [6] 
for  references),  but  these  faster  algorithms  usually  come  with  an  increase  in  sophistication. 
Thus,  the  open-closing  (or  clos-opening)  requires  a  comparable  and,  in  many  cases,  smaller 
computational  complexity  than  a  single  median.  In  addition,  the  iterations  of  the  median 
needed  to  obtain  median  roots  compared  with  the  single  pass  needed  for  the  open-closing 
(or  clos-opening)  make  the  latter  more  appealing. 

In  summary,  the  following  orderings  and  bounds  have  been  established  between  open¬ 
ings,  closings,  medians,  and  median  roots: 

XB  C  med(XB;lF)  C  ( XB)B  C  med000(X;kF)  C  ( XB)B  C  med(XB;VF)  C  XB  .  (12) 

Similar  results  hold  for  functions  too: 

Jb  <  med (fB]W)  <  ( fB)B  <  med°°°(/ ;  W)  <  ( fB)B  <  med (fB-,W)  <  fB  .  (13) 

4.2  Medians  by  2-D  Windows 

Some  of  the  results  concerning  medians  by  1-D  convex  windows  also  apply  for  median 
filtering  of  multi-D  discrete  sequences  by  certain  2-D  windows.  Two  such  windows  shaped 
like  a  7-point  hexagon  are  shown  in  Fig.  3;  the  window  H  is  for  hexagonally- sampled  2-D 
signals,  and  the  window  R  for  rectangularly-sampled  2-D  signals. 

Consider  any  subset  X  of  a  plane  Z2  whose  points  are  arranged  as  on  a  hexagonal  grid. 
Then  the  set  H  has  the  property  that 

z  e  xH  =H  Hz  n  x  \>  4  ,  (14) 
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since  z  E  Xh  iff  there  is  point  y  such  that  z  E  HyC  X ,  and  the  latter  implies  |  Hz  H  X  |>  4 
due  to  the  geometry  of  H.  Based  on  (14)  we  have: 

THEOREM  8  .  For  any  set  X  or  function  f  defined  on  a  hexagonal  grid: 

(a)  XHC  medok(X\  H) CXH  and  fH  <  medok(f ;  H)  <  fH,  Vk  E  Z+. 

(b)  X  -  XH  =  XH  =►  X  =  med(X\  H)  and  f  =  fH  =  fH  =*  f  =  mtd{f\  H ). 

Proof,  (a)  From  (14),  z  E  Xh  ==►  x  E  med(X\H),  and  hence  XnQrned(X;  H).  Then 

.j 

(. Xc)HCmed{Xc-,H )  ^  {XH)CC  [med{X\  H)]c  med{X-,H) C  XH .  By  following  the 
same  procedure  as  in  the  proof  of  Theorem  3a,  we  can  complete  the  proof  of  (a)  both  for 
sets  and  functions.  Finally,  (b)  is  a  simple  corollary  of  (a).  Q.E.D. 

Theorem  8b  is  true  both  for  finite  and  infinite  signals;  the  converse,  even  for  finite 
signals,  is  not  generally  true.  We  prove  this  through  a  counter-example  shown  in  Fig.  4, 
where  we  see  a  finite  set  Y  for  which  Y  =  m ed(Y\H),  but  Y  ^  YH .  Further,  Theorem  7 
is  not  valid  for  2-D  filtering  by  H,  because  neither  the  open-closing  nor  the  clos-opening 
by  H  are  always  roots  of  both  the  opening  and  closing  by  H.  We  prove  this  through  a 
counter-example:  If  Y  is  the  set  of  Fig.  4,  YH  —  (Yh)h  ^  \(Yh)h\h  =  T;  thus  {Yh)H  is 
not  a  root  of  the  opening  and  not  a  median  root  by  H. 

Finally,  Theorem  8  also  applies  to  median  filtering  of  rectangularly-sampled  functions 
/  or  sets  X  by  the  window  R  of  Fig.  3.  That  is,  / r  <  med°k(f]  R)  <  fR  and  /  =  /r  = 
fR  =>  /  =  med(f;R);  the  proof  proceeds  exactly  as  in  Theorem  8  and  exploits  the  fact 
that  z  E  Xr  =^|  Rz  n  X  |>  4,  due  to  the  geometry  of  R. 

5  REPRESENTATION  OF  OS  FILTERS  BY  KER¬ 
NELS  AND  MINIMAL  ELEMENTS 

In  this  section  we  present  the  relations  between  morphological  and  OS  filters  under  the 
unified  framework  of  the  theory  presented  in  [25,26].  Consider  the  SP  filter  T(X)  = 
OSfc(X;VF),  where  k  =  1,2, . . .  ,\W\  —  n  and  X  C  Zm.  Then  the  dual  SP  filter  of  T 
with  respect  to  complementation,  defined  by  ^^(X)  =  [^(Xc)]c,  X  C  Zm,  is  equal  to  the 
(n  —  &  +  l)-th  OS  filter  by  W .  For  instance,  if  'P  is  the  set  erosion,  then  is  the  set  dilation 
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by  W,  and  vice-versa.  If  n  is  odd  and  k  —  (n  +  l)/2,  then  both  \F  and  coincide  with 
the  SP  median  by  W .  The  filter  *F  is  translation-invariant  (in  short,  TI)  and  is  defined  on 
P(Zm)  (the  class  of  all  subsets  of  Zm),  which  is  a  class  of  sets  closed  under  set  translation. 
The  kernel  of  *F  is  defined  generally  by  X’('F)  =  {X  C  Zm  :  0  G  \F(X)},  where  0  is  the 
zero  vector  of  Zm.  Thus  >C(*F)  is  a  collection  of  input  sets  that  can  uniquely  characterize 
and  reconstruct  'F  by  using  translations  [36].  That  is,  \F(X)  =  {a  €  Zm  :  X-a  G  X’('F)}, 
for  each  X.  From  (2), 

JC(tf)  ={X  CZm  :  \X  n  W\  >  k}  .  (15) 

In  [25,26]  we  extended  the  kernel  representation  to  FP  filters  that  are  TI  (see  Table  II 
of  Part  l)  and  are  defined  on  a  class  7  of  functions  closed  under  function  translation. 
The  FSP  filter  ip(f)  =  OS k(f\W)  is  such  a  case  with  7  being,  for  example,  the  class  of 
all  real-valued  functions  /  defined  on  Zm.  The  kernel  of  ip,  defined  generally  by  K{ip)  = 
{/  G  7  :  [V>(/)](0)  >  0},  is  a  collection  of  input  functions  that  can  uniquely  characterize 
and  reconstruct  ip  by  using  translations  and  supremum  [26].  Since  Xt\ip{f)\  =  ^[ATt(/)] 
V*  G  R,  /  €  Kty)  <=>  Xt=Q (/)  €  K{*). 

Since  ^  is  TI  and  increasing ,  it  can  be  realized  as  the  union  of  SP  erosions  by  all  its 
kernel  elements  [36].  Similarly,  since  ip  is  TI,  increasing,  and  commutes  with  thresholding, 
it  can  be  realized  exactly  as  the  pointwise  supremum  of  FSP  erosions  by  all  the  kernel 
elements  of  'F  [26],  However,  these  realizations,  except  for  their  theoretical  interest,  are 
impractical,  because  they  require  an  infinite  number  of  kernel  elements.  This  is  why  we 
introduced  the  concept  of  the  basis  S('F),  of  ’F,  which  is  defined  as  the  set  of  minimal 
elements  of  iC('F).  [The  system  (X’('F),  C)  is  a  partially  ordered  set;  an  element  M  G  K’('F) 
is  minimal  iff,  for  each  A  G  K[^),  ACM  ==>  A  —  M.\  These  minimal  elements  exist 
in  X’('F)  if  'F  is  TI,  increasing,  and  upper  semicontinuous  (u.s.c.)  [26].  Next  we  provide  a 
representation  theorem  for  filters  like  'F  based  only  on  their  basis. 

THEOREM  9  (Maragos  [26,  p.136-137]).  (a)  Let  <t>  :  S  — *  P( Zm)  be  a  TI,  increasing, 
and  u.s.c.  SP  discrete  filter,  where  SQP( Zm)  is  closed  under  translation  and  infinite 
intersection.  Then  <F  is  exactly  represented  as  the  union  of  erosions  by  its  basis  sets.  If  its 
dual  is  u.s.c.,  $  can  also  be  represented  as  the  intersection  of  dilations  by  the  basts  sets 
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of$d. 

(b)  Let  4>  be  a  TI  discrete  FSP  filter  commuting  with  thresholding,  and  $  be  its  respective 
SP  filter.  Then  cf  is  exactly  represented  as  the  pointwise  supremum  of  FSP  erosions  by  the 
basts  sets  of  4>.  If  the  dual  of  $  is  u.s.c.,  (f  can  also  be  represented  as  the  infimum  of  FSP 
dilations  by  the  basis  sets  of  $d. 

Note  that  in  Theorem  9b,  $  and  are  TI  because  <f  is  TI.  Further,  $  is  increasing  and 
u.s.c.  because  <f  commutes  with  thresholding  (see  Section  2.4  of  Part  1);  since  $  is  TI  and 
increasing,  is  TI  and  increasing  too.  Theorem  9  applies  to  median  and  OS  filters  as 
follows. 

THEOREM  10  .  (a)  Let  the  m-D  SP  filter  be  the  k-th  OS  of  sets  by  W CZm,  where 
k  =  1,2, ... ,  \W\  —  n;  its  dual  \F d  is  the  (n  —  k  +  1  )-th  OS  filter  by  W.  The  minimal 
kernel  elements  of  \F  are  all  the  fa)  subsets  P  of  W  with  |P|  =  k,  and  the  minimal  kernel 
elements  of  '&d  are  all  the  (n  ”  k  +  j)  subsets  Q  of  W  with  |Q|  =  n  -  k  +  1.  The  filter  V 
is  equal  to  the  union  of  erosions  by  all  P’s  and  the  intersection  of  dilation  by  all  Q’s. 

(b)  If  the  m-D  FSP  filter  if  is  the  k-th  OS  of  functions  by  W,  then  if  is  equal  to  the 
pointwise  maximum  of  erosions  by  all  the  P’s  and  to  the  minimum  of  dilations  by  all  the 
Q’s.  (See  also  Eqs.  (7),  (8),  (9).) 

Proof,  (a)  From  (15),  if  P  C  W  with  |P|  =  k,  then  P  G  X'('F).  Now,  if  there  is  G  G  K'('F) 
such  that  G  C  P,  k  <  \G  D  W\  <  |G[  <  |P|  =  k  =>  G  =  P.  Hence,  P  is  a  minimal 
element  in  (K’('F),  C).  For  any  other  X  G  X’(^),  X  D  F  =  X  D  W  with  F  C  W  and 
|P|  >  h.  Then  P,  and  thus  X,  contains  a  subset  P  of  W  with  |P|  =  k.  Hence,  the  subsets 
P  of  W  with  |P|  =  k  are  the  only  minimal  elements  in  X’(^).  Since  the  dual  filter  is 
the  (n.  —  k  +  l)-th  OS  by  W,  the  minimal  elements  of  K(^d)  are  all  the  Q  C  W  such  that 
| <?|  =  n  —  k  +  1.  The  filters  ^  and  defined  on  P(Zm),  are  TI,  increasing,  and  u.s.c. 
[26].  Hence,  from  Theorem  9,  'F  is  the  union  of  erosions  by  all  P’s  and  the  intersection  of 
dilations  by  all  Q’s. 

(b)  For  the  FSP  filter  if,  if  the  input  function  is  /,  and  Y  =  Xt(f)  for  any  t  G  R,  then 
'F(F)  is  the  union  of  all  Y  ©  P‘  and  the  intersection  of  all  Y  ®Q*.  Since  \F(T)  =  Xt[if(f)\, 
if  {f)  is  the  maximum  of  all  /  ©  P‘  and  the  minimum  of  all  /  0  Qs.  Q.E.D. 
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Basically,  in  Theorem  10  we  proved  the  same  result  a s  in  Theorem  2  but  without 
using  Theorem  1;  we  used  instead  the  minimal  kernel  elements  of  OS  filters.  Clearly,  the 
advantage  of  the  minimal  elements  approach  is  that  it  unifies  the  representation  of  OS 
filters  as  well  as  of  many  other  filters  [26],  e.g.,  linear  filters  (see  Part  1),  in  terms  of 
morphological  filters.  The  basis  elements  of  openings  and  closings  are  given  by 


THEOREM  11  (Maragos  [26,  p.141-143].  Let  A  C  Zm  with  |.A|  =  n.  Then: 

(a)  The  basis  of  the  SP  opening  filter  'I'(X)  =  Xa,  XC  Zm,  consists  of  the  n  sets  A-a 
where  a  6  A. 

(b)  The  basis  of  the  SP  closing  filter  ^(X)  =  XA  consists  of  all  minimal  subsets  M 
of  A  ©  A"  such  that  0  E  MA.  If  A  is  1-D  and  convex,  then  the  basis  of  'F<i  consists  of  the 
set  {0}  and  the  n{n  —  l)/2  sets  {a,  b}  C  A  ©  A‘  such  that  0  E  {a,  b}A. 


Next  we  provide  some  examples  to  clarify  the  basis  representation  of  median,  opening, 
and  closing  filters. 

Example  1:  Median.  Consider  first  the  1-D  SP  median  'F(X)  =  med(X;VF),  where 
XCZ  and  W  =  {-1,0,1}.  The  kernel  of  is  JC(tf)  =  {X  :  \XnW\  >  2}.  The  kernel 
elements  have  the  form  {. . . ,  —1,0, . . .},  or  {. . . ,  —  1, 1, . . .},  or  {. . . ,  0, 1, . . .}.  Clearly,  there 
is  an  infinite  number  of  kernel  elements.  The  basis  of  '5  has  only  3  elements,  which  are  the 
3  subsets  of  W  containing  2  points  each:  Mi  =  {  —  1,0},  M2  =  {  —  1,1},  and  M3  =  {0,1}. 
Thus,  from  Theorem  10,  the  3-point  median  of  a  function  /(x),  x  E  Z,  is  equal  to 


med{/(x  -  1),  /(x),  /(x  +  1)}  =  max  < 


min{/(x  -  l),/(x)}, 
min{/(x  -  l),/(x  +  l)}, 
min  {/(x),/(x  +  l)} 


> 


(16) 


Since  the  median  operation  commutes  with  set  complementation,  we  can  interchange  min 
and  max  in  (16).  These  max-min  realizations  of  the  median  (and  any  othet  OS)  provide 
geometrical  insight  for  these  nonlinear  filters,  since  they  involve  erosions  and  dilations 
which  are  geometrically  defined  set  operations. 

Consider  now  the  1-D  SP  opening  $(X)  =  Xb  and  its  dual,  the  closing,  filter  $d(X)  = 
Xs,  where  B  =  {0,  l}.  From  Theorem  11,  it  follows  that  the  basis  elements  of  $>  are  the 
two  sets  {-1,0}  and  {  0,1},  and  the  basis  elements  of  <Fd  are  the  two  sets  {0}  and  {  —  1,1}. 
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Thus,  from  Theorem  9b,  the  2-point  opening  of  f(x)  by  B  can  be  expressed  as: 

/ b(x )  =  max{min{f(x-l),f(x)},min{f(x),f(x  +  l)}}  (17) 

=  min  {/(i),max{/(n  —  1),  /(n  +  1)}}  (18) 

By  interchanging  min  and  max:  in  (17),  (18)  we  obtain  the  closing  /B(x),  because  closing 
is  the  dual  of  the  opening.  Obviously,  /#  <  med  [f\W)  <  fB,  as  predicted  by  Theorem  3. 
Realization  of  the  opening  (closing)  by  the  basis  of  its  dual  closing  (opening)  yields  faster 
implementations  of  these  filters,  as  discussed  in  [26]  for  a  general  window  B  with  |  B  |>  2. 

Example  2:  2-D  Max/Median.  Let  W  C  Z2  be  the  3x3  symmetric  square  window, 
and  let  Wx,  W^,  W3,  W±  be  the  3-point  subsets  of  W  that  lie  on  the  lines  passing  through  the 
center  of  W  at  slopes  0,  45,  90,  135  degrees,  respectively.  Then  the  2-D  max/median  (of 
window  size  3)  filter  ip  is  the  pointwise  maximum  of  the  four  1-D  medians  by  Wx ,  ,  W$ , 

and  W4.  This  filter  was  introduced  in  [37]  and  was  found  to  preserve  edges  better  than 

the  median  by  W .  Obviously,  this  filter  commutes  with  thresholding,  and,  hence,  we 

4 

can  focus  our  analysis  on  the  respective  SP  max/median  filter  \I>(X)  =  (J'Iq(X),  XC  Z2, 

t=i 

where  ^.(X)  =  med(X;W,*).  Each  filter  \fr,  has  three  minimal  elements,  i.e.,  the  sets  J3t-y, 
j  =  1,2,3,  with  B{j  C  Wi  and  |RtJ  |  =  2.  Thus  ip  is  the  maximum  of  twelve  2-point  local 
minima  by  the  sets  R,y ,  as  also  recently  observed  in  [37],  and  the  minimum  of  the  12 
respective  local  maxima. 

Example  3:  Linear  Combination  of  Order-Statistics.  Let  J  be  a  class  of  real-valued 
sampled  m-D  functions  closed  under  function  translation.  Let  W  C  Zm  with  |  W  |—  n. 
Given  an  input  function  /  €  7,  the  output  function  from  the  linear  combination  of  order- 
statistics  (LOS)  filter  by  W  is 

[LOS(/)](i)  =  £  a*[OS*(/;  W)]{x)  ,  x  G  Zm.  (19) 

k= 1 

The  parameters  of  the  LOS  filter  are  the  weighting  coefficients  0*  £  R  and  the  shape/size 
of  the  window  W .  This  FP  filter  was  introduced  in  [21],  called  “the  order-statistic  filter”, 
and  used  for  impulse  noise  suppression;  it  was  also  used  in  [22]  for  envelope  estimation  and 
called  “order  filter”.. 

As  for  the  morphological  analysis  of  linear  shift-invariant  filters  in  Part  1,  we  henceforth 
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assume  that  1)  a*  >  0  Vk  (E  {l,2,...,n},  and  2)  =  1,  so  that  the  LOS  filter  be 

*= i 

increasing  and  TI  respectively.  Then  the  LOS  filters  is  also  u.s.c.,  because  it  is  a  finite 
linear  combination  (with  positive  a*’ s)  of  u.s.c.  filters.  If  / ’(*)  =  OSfc{/(y)  :  y  £  IF}, 
k  =  1, . . . ,  n,  the  kernel  of  the  LOS  filter  is  the  collection  of  all  input  functions  /  such  that 
[LOS(/)](0)  >  0;  i.e., 

K (LOS)  =  |/  G  7  :  £  ak  f{k)  >  0  j  .  (20) 

From  K (LOS)  we  can  reconstruct  the  LOS  filter  exactly  [26].  Moreover,  we  can  find  the 
set  of  minimal  kernel  functions  in  X”(LOS),  i.e.,  the  basis  of  the  LOS  filter  as  follows: 

THEOREM  12  .  Let  W  C  Zm  with  \W\  =  n,  and  consider  0i,02,...,a„  6  R  with  ak  >  0 

n 

for  each  k  and  £a,t  =  1.  Then  the  basis  of  the  LOS  filter  defined  in  (19)  is  equal  to 

k=  1 

B(LOS)  =  jy  6  /  :  £  ak  —  0  and  g(x)  =  —  oo  Vx  ^  IF  j  ,  (21) 

where  g^k)  =  OSk{g(y)  :  y  6  W},  k  =  1,2, . . .  ,n.  Moreover,  V  f  E  J,Vi  6  Zm, 

[LOS(/)](x)  =  sup  (mm{f{y)  -  g(y  -  x)}}.  (22) 

,eB(Los)  lv€VV‘  J 

Proof,  (a)  Let  B  be  the  function  class  of  (21).  B  is  nonempty  because  g*  €  B,  where 
y*(x)  =  0  Vx  €  IF  and  g*(x)  =  — oo  Vx  £  IF.  Assume  that  some  g  E  B.  From  (20)  and 
(21),  y  €  IC(LOS).  Let  h  6  IC(LOS)  such  that  h  <  g.  Then  h(x)  =  y(x)  =  — oo  Vx  0  IF, 

n 

and  0  <  [LOS(/i)](0)  <  [LOS(y)](0)  =  0  =>  J2ak[9(k)  ~  h(k)\  =  0.  Hence,  gw  =  hw  Vk, 

k=l 

because  ak  >  0  and  g (*.)  >  h (k)  Vk,  since  h  <  g.  Now,  h =  g Vk  and  h  <  g  =>•  h{x)  = 
g(x)  Vx  6  W  =$>  h  —  g.  Thus  g  is  a  minimal  kernel  function;  i.e.,  g  £  At,  where  M  denotes 
the  true  basis  of  the  LOS  filter.  Hence,  B  Q  M. 

Let  now  g  £  M.  Then  g  must  have  a  minimal  region  of  support  and  hence  y(x)  = 
—  oo  Vx  §*  IF.  Further,  [LOS(y)](0)  =  p  >  0.  If  p  >  0,  the  function  h  defined  by  h(x)  — 
— oo  Vx  and  /i(x)  =  g(x)  —  p,  x  £  W ,  is  a  kernel  function  (because  (LOS(h)](0)  =  0) 
with  h  <  g  and  h  ^  g;  this  is  a  contradiction,  however,  because  g  is  minimal.  Hence  p  —  0 
and  thus  g  £  B  implying  that  M  C  BC  M  =>  M  =  B. 

(b)  Since  the  filter  is  TI  increasing  and  u.s.c.,  it  is  equal  to  the  supremum  of  FP  erosions 
by  its  basis  functions  [26],  from  which  (22)  results.  Q.E.D. 
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As  an  illustration  of  Theorem  12,  we  provide  below  an  example  where  we  restrict  the 
amplitude  range  of  all  functions  in  7  to  be  discrete,  say  Z,  and  the  coefficients  a *  to  be 
positive  rational  numbers.  Let  W  —  {—1,0,  l}CZ  and  consider  the  LOS  filter  \ip(f)}(x)  — 

3 

Y^ak\OSk(f  :  W)](x),  x  G  Z,  whose  basis  is  B.  If  g  G  B ,  let  gi  =  g(-l),g2  =  g(0),g3  —  0(1). 

jt=i 

Then,  +  a2g[2)  +  a3 0(3)  —  0-  Without  loss  of  generality  we  can  assume  that  =  1 

(note  that  always  >  0  and  #(„)  <  0  from  (21)),  because  y(x)  G  B  pg(x )  G  B  for 

any  p  G  N  =  Z+  U  {0}.  Since  Ui  +  a2  +  a3  =  1,  we  must  solve 

a2<7(2)  +  gs<7(3)  =  a2  +  a3  —  1  (23) 


subject  to 


1  >  9(2)  >  1  - 


1 

a2  +  a3 


>  9(3)  , 


(24) 


where  g(2)  and  g (3)  are  the  integer  unknowns.  To  each  solution  (fir(i),fif(2),ff(3))  there  corre¬ 
sponds  a  multitude  of  3-tuples  (gi,g2,g3)  whose  number  is  equal  to  the  number  of  distinct 
permutations  of  the  3-tuple  (ff(i), &(2)> fl'(3))-  The  solutions  of  (23)  can  be  obtained  from 
a  search  of  the  finite  region  of  Z2  delineated  by  the  constraints  (24).  For  example,  let 
a2  =  2/4  and  ai  =  a3  =  1/4.  Then,  the  solutions  are 


(0(1),  0(2).  0(3)) 

(01  =  0(“1),02  =  0(0), 03  =  0(1)) 

(1,0, -1) 

(1,0,-1),(0,1,-1),(-1,0,1),(1,-1,0),(-1,1,0),(0,-1,1) 

(1,1, -3) 

(l  >1,-3),  (-3, 1,1), (1, -3,1) 

Let  jC  be  the  set  of  the  9  basis  functions  defined  by  (<7i,<72i<?3)  in  the  above  table.  Then 
B{i 0  =  {pg{x)  :  p  G  N,  g(x )  G  £}.  Thus, 


X>*OS*(/;W0 

jt=i 


(x)  =  sup  \  max  min{/(y)  -  pg(y  -  x)}  \  . 
p£N  f  Lvew,  J  J 


Finally,  it  is  straightforward  to  extend  the  above  procedure  to  LOS  filters  with  n  >  3. 


6  RELATIONS  BETWEEN  MORPHOLOGICAL  AND 
STACK  FILTERS 

Before  we  discuss  the  relations  between  morphological  and  stack  filters,  a  few  definitions 
are  needed  from  the  theory  of  Boolean  functions  [30,31].  Any  Boolean  expression  of  n 
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variables  xx,  x2, ...  ,  xn  £  {0,1}  can  be  written  as  Boolean  sum-of-products  (SOP)  terms 
or  as  Boolean  product-of-sum  (POS)  terms.  Each  product  or  sum  term  may  contain  each 
literal  (a  variable  x,-  or  its  complement  x[)  at  most  once  and/or  the  Boolean  constants  0  or 
1.  To  each  Boolean  expression  there  corresponds  a  unique  Boolean  function  /?(x)  £  {0,  l}, 
where  x  =  (xx,x2, . . .  ,  xn).  A  Boolean  function  is  usually  described  through  a  truth  table. 
Two  Boolean  expressions  are  called  equivalent  if  they  correspond  to  the  same  Boolean 
function.  A  Boolean  function  7  is  said  to  iryiply  (3  iff  /?(x)  =  1  for  each  x  such  that 
7(x)  =  1.  A  prime  implicant  n  of  (3  is  a  product  term  which  implies  (3 ,  such  that  deletion 
of  any  literal  from  n  results  in  a  new  product  which  does  not  imply  (3 .  A  prime  implicate 
of  [3  is  a  sum  term  o  implied  by  /?,  such  that  deletion  of  any  literal  from  o  results  in 
a  new  sum  term  which  is  not  implied  by  /?.  Any  minimal  SOP  (resp.  POS)  expression 
for  (3  is  a  sum  (resp.  product)  of  prime  implicants  (resp.  prime  implicates)  such  that 
removal  of  any  of  them  makes  the  remaining  expression  no  longer  equivalent  to  (3 ,  and  the 
expression  contains  the  minimum  number  of  literals  and  product  (resp.  sum)  terms.  This 
minimal  expression  is  not  necessarily  unique.  A  function  /?(x)  is  called  positive  if  it  can  be 
represented  by  a  SOP  or  POS  expression  in  which  no  variable  appears  in  uncomplemented 
form.  Each  positive  function  has  a  unique  minimal  SOP  expression  that  is  positive  and  is 
the  sum  of  all  its  prime  implicants;  it  also  has  a  unique  minimal  POS  expression  that  is 
positive  and  is  the  product  of  all  its  prime  implicates. 

6.1  Stack  Filters 

Wendt  et  al.  [27,28]  defined  the  stack  filters  as  follows.  Consider  an  input  function 
/(z),  z  £  Zm,  with  a  finite  number  M  of  amplitude  levels.  Threshold  /  at  all  ampli¬ 
tudes  t  £  {0, 1, . . . ,  M  —  1},  obtain  its  cross-sections  Xt(f),  and  consider  their  respective 
characteristic  functions  Xx,(/)(2)>  or  simply  Xt{z)-  Filter  all  binary  signals  Xt  by  a  TI, 
discrete,  increasing,  binary  filter  $4.  (In  [27,28]  the  increasing  property  of  $4  is  called 
“stacking  property”.)  Then  fx  <  t2  ==>  X^  >  Xf2  =>•  $fc(Xii)  >  $»(xi2)-  Assume  that 
at  each  z  £  Zm  the  value  of  the  output  [$4(fc)](z)  is  determined  only  from  the  values 
of  the  input  signal  fc(z)  inside  a  fixed  finite  window  W  of  n  points  shifted  at  location  z. 
Since  $4  is  TI  and  binary  filter,  its  defining  rule  can  be  represented  by  the  truth  table  of 
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a  Boolean  function  /3(x  1( Z2, . . . , xn),  where  the  variables  represent  the  n  values  k(y ), 
y£Wz  =  {z  +  w:w£  W},  of  the  input  signal  k(z )  inside  Wz.  Let  x  =  ( Xi,x2 , . .  ■  ,xn)  and 
y  =  (j/x 9  2/2 >  •  •  • » Dn)  represent  two  vectors  in  {0,1}",  and  define  a  partial  ordering  relation 
<  in  {0, 1}"  through  the  rule  x  <  y  x,-  <  yt-  Vt.  The  fact  that  is  an  increasing  filter 
is  equivalent  to  the  condition  x  <  y  =>•  /?(x)  <  (3( y)  Vx,y  6  {0,l}n,  which  in  turn  is 
equivalent  to  /?  being  a  positive  Boolean  function  [29].  Finally,  the  multilevel  function 

M-l 

|ST^(/)]W  =  E  [*>fc„„)]W  .  *  e  Z“  .  (25) 

t=0 

is  viewed  as  an  output  function  for  each  input  /(z),  and  thus  the  stack  filter  ST^  is  defined. 
By  varying  /?,  or  equivalently  a  different  stack  filter  is  obtained. 

As  an  aside,  for  input  functions  /  whose  amplitude  range  is  a  continuum,  say  R,  we 
can  extend  the  definition  (25)  as 

[ST„(/)](z)  =  /R[<MX,, „,)](*)*  •  (26) 

6.2  Morphological  Analysis  of  Stack  Filters 

Any  stack  filter  ST^,  by  its  construction,  is  a  TI  discrete  FSP  filter  commuting  with 
thresholding;  hence  it  is  increasing  and  u.s.c.  too  (due  to  Theorem  3  of  Part  l).  To  each 
binary  filter  we  can  uniquely  associate  a  SP  filter  $,  such  that  whenever  $  operates 
on  a  set  A  C  Zm,  $(,  operates  on  the  characteristic  function  xa  of  A,  and  vice-versa.  $  is 
TI  and  increasing  iff  3>j  is  TI  and  increasing;  further,  $  is  u.s.c.  due  to  the  finite  window 
W.  Then  $  is  the  respective  SP  filter  of  the  FSP  filter  ST p,  and  from  our  discussion  in 
Section  2.4  of  Part  1, 

\STfi{f)]{z)  =  sup {t  e  V  :  *  G  *[*,(/)]}  ,  (27) 

where  V  can  be  either  R  or  Z  and  Xt[ST)g(/)]  =  $[A<(/)]  Vt  6  V.  Thus  the  sum-definition 
of  ST^  in  (25)  is  only  a  special  case  of  its  sup-definition  in  (27).  For  a  finite  number  of 
amplitude  levels  t,  the  supremum  becomes  a  maximum;  in  [28,38]  the  usefulness  of  this 
max-definition  of  stack  filters  is  recognized  for  fast  VLSI  implementations. 

For  the  cases  when  /3(xx>  ..,xn)  is  a  threshold  function  [30],  Wendt  et  al.  [28]  provided  a 
functional  definition  for  ST^  as  a  generalization  of  OS  filters,  in  which  multiple  repetitions 
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of  the  same  element  are  allowed.  In  [27,28]  all  the  stack  filters  corresponding  to  the  20 
positive  Boolean  functions  of  n  =  3  variables  were  examined.  To  obtain  a  functional 
definition  for  ST^  from  a  threshold  function  would  be  inefficient  for  large  n  because  of 
the  large  number  of  repetitions  of  the  same  elements  and  because  deriving  the  threshold 
function  form  a  large  truth  table  is  not  a  simple  task.  In  addition,  for  n  >  3  not  all  positive 
Boolean  functions  are  threshold  functions.  For  example,  in  [28]  it  was  observed  that,  of 
the  7581  positive  functions  with  n  <  5,  only  3287  are  threshold  functions;  hence  it  was 
conjectured  that  there  are  many  stack  filters  whose  outputs  cannot  be  expressed  as  simple 
functions  of  the  input  samples.  However,  by  using  morphological  concepts,  we  provide 
below  a  general  algorithm  that  obtains  from  the  SOP  or  POS  positive  Boolean  expressions 
of  P  the  functional  definition  of  any  stack  filter  ST^g  in  terms  of  max-min  operations: 

(A)  Let  W  C  Zm  be  the  window  of  n  points  associated  with  (3(xi,  x2, . . . ,  x„)  and  let 
/(•)  be  an  index  function  that  assigns  to  each  w  £  W  a  unique  integer  I[w )  in  {1, 2, . . . ,  n}. 
For  example,  let  m  =  1,  n  =  3,  W  =  {  —  1,0,  l},  and  I(w)  =  w  +  2,  w  £  W . 

(B)  Obtain  the  minimal  SOP  and  POS  expressions  for  /?;  e.g., 

P(x1,x2,x3)  =  XiX2  +  x2x3  =  x2(xi  +  x3).  (28) 

(C)  Obtain  the  respective  SP  filter  $  operating  on  an  input  set  S  by  replacing:  the 
Boolean  sum/product  (logical  OR/AND)  with  union/intersection,  respectively;  and  each 
variable  z,-  in  ft  by  a  translation  S-w  of  5,  where  w  E  W  and  I(w)  =  i.  For  example, 

$(S)  =  (5  n  50  U  (5  n  5_0  =  5  D  (S1  U  5_0  .  (29) 

(D)  Obtain  the  respective  stack  filter  ST^  from  $  by  replacing:  the  set  5  in  (C)  with 
the  cross-sections  Xt(f)  of  an  input  function  f(z);  the  finite  union/intersection  of  cross- 
sections  with  pointwise  max/min,  respectively,  of  functions;  and  cross-section  translations 
[Xt(/)]-«j  with  function  shifts  f(z  +  w).  For  the  example  of  (29),  ST^g(/)  assumes  a  max- 
min  and  a  min-max  functional  definition  identical  to  the  realizations  of  the  opening  / b , 
B  —  {0,  l},  in  (17)  and  (18).  Moreover,  with  the  hindsight  obtained,  we  can  combine  steps 
(C)  and  (D)  in  a  single  step: 

(C*)  Obtain  the  functional  definition  of  ST^  from  /?  by  replacing:  each  Boolean 
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sum/product  with  a  max/min,  respectively;  and  each  variable  x,  by  a  shifted  version 
f(z  +  w)  of  the  input  function  f(z),  where  w  £  W  and  I(w)  =  i. 

Concluding,  each  stack  filter  can  be  expressed  as  a  finite  max-min  or  min-max  oper¬ 
ation.  Conversely,  any  finite  max-min  or  min-max  operation  is  TI  and  commutes  with 
thresholding  [23];  hence  it  corresponds  to  a  TI  increasing  u.s.c.  SP  filter,  or  equivalently 
to  a  positive  Boolean  function,  which  in  turn  defines  a  stack  filter.  Therefore,  the  stack 
filters  are  the  class  of  all  discrete  FSP  filters  that  are  TI,  commute  with  thresholding,  and 
can  be  expressed  as  a  finite  maximum  of  local  minima  or  as  a  minimum  of  local  maxima. 
Thus,  discrete  FSP  erosions,  dilations,  closings,  openings,  open-closings,  medians,  and  OS 
filters,  as  well  as  any  finite  cascade  or  parallel  (using  poitwise  min-max)  combination  of 
these  filters,  are  all  special  cases  of  stack  filters.  However,  the  general  FP  erosion,  dilation, 
opening,  or  closing  of  a  function  /  by  another  non-binary  structuring  function  g  (defined 
in  of  Part  1),  as  well  as  any  finite  cascade  or  parallel  combination  of  these  FP  filters  do 
not  commute  with  thresholding  and  hence  they  are  not  stack  filters.  Moreover,  these  latter 
morphological  filters  include  the  stack  filters  as  a  special  case,  because  they  become  stack 
filters  whenever  all  the  structuring  functions  involved  in  their  definition  become  binary. 
Finally,  the  original  definition  of  stack  filters  in  (25)  via  Boolean  functions  allows  only  for 
discrete  filters,  whereas  our  definition  in  (27)  via  TI  increasing  u.s.c.  SP  filters  allows  for 
both  discrete  and  analog  filters. 

6.3  Minimal  Elements  of  Stack  Filters 

Theorem  9  applies  to  any  stack  filter  ST^  and  its  respective  SP  filter  $.  That  is,  ST^ 
can  be  represented  as  a  supremum  of  FSP  erosions  by  all  the  basis  sets  of  $  and  also 
as  an  infimum  of  FSP  dilations  by  all  the  basis  sets  of  its  dual  SP  filter  Next  we 
will  establish  some  connections  between  these  ideas  and  the  representation  of  the  positive 
Boolean  function  (3  by  a  minimal  SOP  and  POS  expression. 

In  (0,  l}n,  a  vector  x  =  (xj,  X2, . . .  ,x„)  is  called  a  minimal  true  vector  of  (3  iff  /3(x)  —  1 
and  x  is  not  preceded  (with  respect  to  the  vector  ordering  ^)  by  any  other  vector  v  with 
f3(v)  —  1.  A  vector  y  £  (0,  l}n  is  called  a  maximal  false  vector  of  (3  iff  /3(y)  =  0  and  y 
is  not  followed  (with  respect  to  ^)  by  any  other  vector  u  with  /3(u)  =  0.  The  Boolean 
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function  0d(x)  —  /?'(x'),  x'  =  (x'j,  x'2, . . .  ,2^),  is  called  the  dual  function  of  0.  Since  (3  is 
positive,  (3d  is  positive  too.  Hence,  to  /3d  there  corresponds  a  unique  TI  increasing  u.s.c. 
SP  filter  which  is  the  dual  of  In  addition,  we  have  the  following. 

THEOREM  13  .  Let  ST^  be  a  m-D  stack  filter,  whose  defining  rule  is  associated  with 
a  fixed  window  W  of  n  points.  Let  $  be  its  respective  SP  filter,  whose  dual  SP  filter  is  $d. 
Consider  the  positive  Boolean  function  0(x\,  x^, . . . ,  in)  corresponding  to  3>  and  tts  dual 
function  (3d  corresponding  to  $d.  Let  I  :  W  — *•  {1, 2, . . . ,  n}  be  a  one-to-one  index  function. 
Then: 

(a)  The  stack  filter  ST^  can  be  expressed  as  a  finite  pointwise  maximum  of  moving  local 
minima  and  also  as  a  finite  minimum  of  moving  local  maxima. 

(b)  The  stack  filter  ST pd.  defined  by  (3d  can  be  obtained  from  ST^  by  interchanging  max 
with  min. 

(c)  To  each  minimal  true  vector  a  =  (ai,  d2, . . . ,  an)  of  (3  there  corresponds  a  unique 
minimal  kernel  element  G  —  {w  €W  :  a/(w)  =  1}  o/$,  and  vice-versa.  To  each  SP  erosion 
by  G  there  corresponds  a  unique  prime  implicant  of  (3. 

(d)  To  each  minimal  true  vector  b  =  (6i,...,6n)  of  (3d ,  and,  equivalently,  to  each 
maximal  false  vector  of  (3,  there  corresponds  a  unique  minimal  kernel  element  H  =  {w  E 
W  :  6/(^)  =  1}  of  $d,  and  vice  versa.  To  each  SP  dilation  by  H  there  corresponds  a  unique 
prime  implicant  of  (3d,  and,  equivalently,  a  unique  prime  implicate  of  (3 . 

Proof:  (a)  was  shown  in  Section  6.2.  (b)  The  function  0d  is  obtained  from  0  by  inter¬ 
changing  Boolean  sums  with  products  and  1  with  0  (De  Morgan’s  laws).  The  filter  ST^ 
is  obtained  from  0d  by  replacing  Boolean  sum/product  with  max/min.  Hence,  ST^j  can 
be  obtained  from  ST^  by  interchanging  max  with  min. 

(c)  $  has  at  least  one  basis  set,  because  $  is  TI  increasing  and  u.s.c.  [26].  The  subset 
G  of  W  belongs  to  the  kernel  of  $,  because  0(a)  =  1  =>  0  €  $(Gx)  for  some  x  6  Zm, 
and  since  $  is  TI  we  can  assume  without  loss  of  generality  that  2  =  0.  Since  /(•)  is 
one-to-one,  the  correspondence  a  *-*  G  is  one-to-one.  Hence,  G  is  minimal  with  respect  to 
set  inclusion  since  a  is  minimal  with  respect  to  vector  ordering  <.  From  the  vector  a  we 
can  obtain  the  product  p  =  x,lx ,-2  .  . .  x ,t  where  ir  G  {l, .  .  .  ,  n}  for  r  =  1, .  . .,  k  <  n  and 
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p  contains  the  variable  xy  iff  ay  =  1.  The  correspondence  a  <->  p  is  one-to-one  because  p 

contains  no  complemented  variables.  Since  a  is  a  minimal  true  vector  of  (3,  p  is  a  prime 

implicant  of  j3.  The  positive  Boolean  function  (3  can  be  expressed  as  the  sum  of  all  its 

prime  implicants,  which  are  all  positive.  Equivalently,  the  TI  increasing  u.s.c.  SP  filter 

$  can  be  expressed  as  the  union  of  SP  erosions  by  all  its  basis  sets  [26].  Thus  all  the 

correspondences  p^anGn  'F(X)  =  X  ©  Gs  =  p|  X-w  are  one-to-one.  Hence  the 

w€G 

prime  implicant  p  corresponds  to  the  SP  erosion  by  G  by  replacing  each  Xj  in  p  with  X-w, 
where  I(w)  —  j,  and  the  Boolean  product  with  D. 

(d)  From  the  proof  of  part  (c),  the  correspondences  between  the  minimal  true  vectors 
b  of  the  positive  Boolean  function  /3d,  the  basis  sets  of  (which  exist  for  the  same 
reasons  as  for  $),  and  the  prime  implicants  of  /3d  are  all  one-to-one.  The  vector  b  is  the 
dual  of  a  maximal  false  vector  of  (3,  because  /3d(b)  =  1  <=>  (3(h')  =  0.  Equivalently, 
each  prime  implicant  of  (3d  is  the  dual  of  a  prime  implicate  of  (3,  and  the  minimal  SOP 
expression  for  /3d  is  the  dual  of  the  minimal  POS  expression  for  (3 .  Thus,  the  subset  H  of 
W  corresponds  to  the  prime  implicate  s  =  x, -,+•••  +  x,k  of  (3,  where  ir  G  {l, . . .  ,n}  for 
r  =  1, . . . ,  k  <  n,  and  s  contains  the  variable  xy  iff  6y  =  1.  Hence,  s  yields  a  SP  dilation 
filter  \I>(X)  =  X©iP  =  (J  X-w  by  replacing  each  xy  in  s  with  X-w,  where  I{w)  =  j,  and 

w£H 

the  Boolean  sum  with  U.  Q.E.D. 

The  following  example  clarifies  Theorem  13  and  its  proof. 

Example  4.  Consider  the  1-D  FSP  opening  cf>(f )  —  /a  where  A  =  {  —  1,0,1}.  Thus 
fA(x)  =  max{0(x-l),  <?(x),sr(x+l)},  where  g(x)  =  min{/(x- 1),  f(x),  f(x+ 1)},  x  G  Z.  Its 
respective  SP  filter  is  3>(X)  =  XA,  X  C  Z,  and  its  dual  SP  filter  is  the  closing  $d(X)  =  XA. 
From  Theorem  9a,  VX  C  Z, 

Xx=  U  X  ©  =  f)  X©iT,  (30) 

GeS($) 

where  the  basis  of  $  and  can  be  found  from  Theorem  11.  That  is,  B(3>)  — 

{{— 2,  —1,0},  {—1,0,1},  {0, 1,2}}  and  8  (3>d)  =  {{0},  {-2,  l},  {-1,  l},  {-1,2}}.  From  The¬ 
orem  9b  we  obtain  a  functional  definition  for  4>  as  [set  /,■  —  f(x  —  3  +  i),  i  =  1,2, 3, 4,  5] 

fA{x)  =  max{min(/i ,  /2 ,  /3) ,  min(/2 ,  /3l  fi) , min(/3,  /4)  /6) }  (31) 

=  min{/3,  max(/l5  /4),  max(/2,  fi),  max(/2,  /5)}.  (32) 
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Since  <f>  is  a  stack  filter,  we  can  also  obtain  the  above  max-min  and  min-max  definitions 
for  (j>  from  its  respective  Boolean  function.  That  is,  let  0  and  its  dual  0d  be  the  positive 
Boolean  functions  corresponding  to  the  increasing  SP  filters  4>  and  respectively.  The 
window  associated  with  <f>,  4>,  is  W  =  A  ©  A‘  =  {— 2,  — 1, 0, 1, 2}.  Thus  0  and  0d  will 
be  functions-  of  5  variables  xi,x2,x3,x4,xs,  where  the  index  function  is  I(w)  —  w  +  3, 
w  €  W .  Next  we  summarize  how  to  obtain  0  and  0d  from  the  basis  of  $  and  <frd,  by  using 
Theorem  13c, d. 


basis  sets  of  $ 

basis  sets  of  $d 

{-2, -1,0}, {-1,0,1}, {0,1, 2} 

{0}, {-2,1}, {-1,1}, {-1,2} 

min.  true  vectors  of  0 

min.  true  vectors  of  0d 

(1,1, 1,0,0), (0,1, 1,1,0), (0,0, 1,1,1) 

(0,0,1, 0,0), (1,0, 0,1,0),  (0,1, 0,1,0), (0,1, 0,0,1) 

prime  implicants  of  0 

prime  implicants  of  0d 

XiX2X3,  X2X3X4,  X3X4XS 

£3, 

prime  implicates  of  0d 

prime  implicates  of  0 

X1  +  x2  +  X3,  X2  +  X3  -f  X4,  X3  +  X4  +  I5 

X3 ,  Xi  +  X4,  X2  +  X4,  X2  +  X5 

Each  of  the  positive  Boolean  functions  0  and  0d  can  be  expressed  now  in  minimal  SOP 
(POS)  form  as  the  sum  (product)  of  its  prime  implicants  (implicates).  For  example 


0{xx,x2,  x3,x4,  x5)  =  xxx2x3  +  x2xzx±  +  X3Z4Z5  (33) 

=  Xi(xi  +  xA)(x2  +  x4)(x2  +  x5)  (34) 

By  replacing  Boolean  sum  with  max  and  product  with  min,  we  obtain  from  (33)  the 
max-min  definition  of  the  FSP  opening  in  (31)  and  from  (34)  its  min-max  definition  in 
(32). 

Note  that  if  we  exchange  in  all  the  discussion  of  Example  4  the  roles  of  4>  and  or, 
equivalently,  the  roles  of  0  and  0d,  we  obtain  the  max-min  and  min-max  definitions  of  the 

dual  stack  filter  of  (j>,  i.e.,  the  closing  /  — ►  fA ,  by  replacing  the  roles  of  max  and  min  in 

(31,32). 

The  3-point  opening  /a  and  closing  fA  are  comparable  with  the  5-point  median  med(/ ;  W) , 
as  Section  4  explains.  From  Theorem  10,  the  SP  median  by  W  has  10  basis  sets,  i.e.,  all 
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the  3-point  subsets  of  W,  and  is  identical  to  its  dual  filter.  Hence,  its  respective  positive 
Boolean  function  has  a  unique  minimal  expression  as  the  sum  of  the  10  prime  implicants 
X{XjXk,  where  i,j,  k  G  {1,2, 3, 4, 5}  and  i  j  ^  k. 

Concluding,  the  two  approaches  of  representing  stack  filters  either  by  their  basis  (min¬ 
imal  kernel  elements)  or  by  their  Boolean  functions  in  minimal  SOP  or  POS  forms  have 
many  analogies,  which  are  summarized  by  Theorem  13.  In  addition  the  following  compar¬ 
isons  are  evident:  1)  For  small  windows,  e.g.,  of  3  points,  both  approaches  are  relatively 
simple  to  apply.  2)  For  large  windows,  e.g.,  with  number  of  points  >  5,  to  find  minimal 
SOP  or  POS  expressions  for  Boolean  functions  is  a  computationally  complex  task  and  has 
become  the  objective  of  extensive  research  in  the  field  of  switching  theory.  By  contrast, 
for  stack  filters  (of  any  window  size)  that  are  parallel  or  cascade  combinations  of  median, 
OS  filters,  erosions,  dilations,  openings,  or  closings,  we  can  find  their  basis  immediately 
from  Theorems  10,11  and  hence  their  max-min  definition  from  Theorem  9.  In  addition, 
from  the  basis  we  obtain  the  Boolean  functions  in  minimal  SOP  or  POS  expressions  as 
a  by-product.  3)  For  large  windows  and  arbitrary  stack  filters  whose  definition  does  not 
allow  easily  to  find  their  basis,  the  Boolean  function  seems  at  first  more  helpful  since  there 
are  standard  algorithms  [30,3 1]  to  find  its  minimal  SOP  or  POS  forms.  In  these  cases  the 
Boolean  function  approach  can  also  be  seen  as  an  algorithm  (together  with  Theorem  13) 
to  find  the  basis. 


7  CONCLUSIONS 

We  have  extended  the  theory  of  median,  OS,  and  stack  filters  by  introducing  the  use  of 
mathematical  morphology  to  analyze  them  and  to  relate  them  with  morphological  filters. 
OS  filters  are  both  function-  and  set-processing  (FSP).  Using  morphological  concepts,  we 
showed  that  OS  filters  commute  with  thresholding.  This  fact  allows  to  analyze  OS  filters 
by  focusing  only  on  OS  of  sets.  OS  of  sets  are  easier  to  analyze  and  implement,  because 
their  definition  involves  counting  of  points,  in  contrast  to  the  sorting  of  numbers  required 
for  OS  of  functions. 

We  have  shown  that  each  k- th  OS  filter  by  a  window  W  of  n  points  is  equal  to  the 
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maximum  of  the  local  minima  (erosions)  by  all  fc-point  subsets  of  W  and  to  the  minimum 
of  the  local  maxima  (dilations)  by  all  (n  —  k  +  l)-point  subsets  of  W ;  this  representation 
is  given  by  a  closed  formula  which  does  not  involve  sorting.  We  proved  this  max-min 
representation  of  OS  filters  by  using  first  a  combinatorial  proof  and  second  their  kernel 
and  basis  (minimal  kernel  elements)  representation.  The  minimal  kernel  elements  of  the 
k- th  OS  filter  by  W  are  all  the  A>point  subsets  of  W .  The  minimal  elements  approach 
allows  to  unify  OS  filters  together  with  a  large  class  of  linear  and  nonlinear  filters  which 
can  be  expressed  as  a  supremum  or  union  of  erosions. 

We  have  found  that  medians,  openings,  and  closings  are  closely  related.  If  W  is  a  1-D 
convex  symmetric  (2 n  +  l)-point  window  and  B  is  a  1-D  convex  (n  +  l)-point  set,  the 
median  (and  its  iterations)  of  any  signal  by  W  is  bounded  below  by  the  opening  and  above 
by  the  closing  by  B.  If  a  signal  is  a  root  of  both  the  opening  and  closing  by  B,  then 
it  is  a  root  of  the  median  by  W .  (The  converse  is  true  only  for  signals  of  finite  extent.) 
Hence,  median  roots  with  respect  to  W  can  be  obtained  by  finding  signals  that  are  roots 
of  both  the  opening  and  the  closing  by  B.  For  example,  the  open-closing  or  clos-opening 
by  B  provide  roots  of  the  median  by  W  in  a  single  pass.  Moreover,  the  median  root 
obtained  through  iterating  the  median  filter  -by  W  on  a  finite  extent  signal  is  bounded 
from  below  and  above,  respectively,  by  the  open-closing  and  clos-opening  by  B\  it  was 
also  experimentally  observed  that  this  median  root  lies  close  to  the  open-closing  and  clos- 
opening.  These  results  combined  with  the  fact  that  open-closing  requires  comparable  or 
less  computational  complexity  than  a  single  median,  (and,  hence,  much  less  complexity 
than  iterating  the  median,)  makes  the  open-closing  (or  clos-opening)  more  appealing.  For 
suppressing  impulse  noise  in  signals,  the  open-closing  behaves  very  similarly  to  the  median; 
in  addition,  it  can  discriminate  between  positive  and  negative  noise  spikes,  whereas  the 
median  cannot.  Some  similar  results  were  obtained  for  2-D  filtering. 

Finally,  we  have  shown  that  the  stack  filters,  whose  original  definition  [27,28]  was  based 
on  positive  Boolean  functions,  are  actually  the  class  of  all  finite  maxima  of  local  minima 
and  minima  of  local  maxima  filters.  As  such,  they  contain  all  median  and  OS  filters,  and 
only  those  FSP  morphological  filters  that  commute  with  thresholding.  Stack  filters  can 
be  expressed  as  minimal  forms  of  max-min  operations  based  either  on  irreducible  forms 
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of  their  Boolean  functions  or  on  their  minimal  kernel  elements.  We  have  established  the 
theoretical  equivalence  of  both  of  these  approaches  and  provided  a  systematic  algorithm 
to  find  the  max-min  expression  of  any  stack  filter  from  its  Boolean  function. 

Thus,  FSP  erosion  and  dilation  are  the  prototypes  for  representing  any  median,  OS, 
or  stack  filter.  Since  all  these  filters  commute  with  thresholding  and  set  erosion/dilation 
can  be  implemented  using  an  intersection/union  of  shifted  versions  of  the  input  set,  the 
erosion/dilation  (min /max)  representation  of  OS  and  stack  filters  suggests  simple  methods 
for  their  parallel  implementation. 

In  short,  mathematical  morphology  combined  with  the  minimal  elements  representa¬ 
tion  provides  a  self-contained  mathematical  framework  that,  based  on  simple  concepts, 
facilitates  the  theoretical  analysis  of  all  the  above  nonlinear  filters,  establishes  their  inter¬ 
relationships,  suggests  methods  for  their  implementation,  and  further  relates  them  to  a 
large  class  of  nonlinear  filters,  linear  filters,  and  algorithms  for  shape  analysis  [26,39], 
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CAPTIONS  OF  FIGURES 


Figure  1.  (a)  A  256  x  256-pixel  (8-bit/pixel)  graytone  image  /  corrupted  with  salt-and- 
pepper  noise;  SNR=15.1  dB.  (Probability  of  occurrence  of  noisy  samples  is  0.1.)  (b)  Open¬ 
ing  /b  of  /  by  a  2  x  2-pixel  square  set  B\  SNR=19.5  dB.  (c)  Open-closing  (/b)b;  SNR=25.8 
dB.  (d)  Median  of  /  by  a  3  x  3-pixel  window;  SNR=29.1  dB.  (The  SNR’s  were  computed 
by  20  log10(255/ermJ),  where  erm,  was  the  rms-value  of  the  difference  between  the  original 
and  the  noisy  or  restored  images.) 

Figure  2.  (a)  Original  1-D  function  /.  (b)  Its  open-closing  (/b)b  by  B  =  {  —  1,0,1}. 
(c)  Its  clos-opening  (/b)b.  (d)  Its  median  root  med°°°(/;  W)  by  W  =  {—2, —1,0, 1, 2}. 

Figure  3.  2-D  median  filtering  windows:  H  for  hexagonal  grids  and  R  for  rectangular 
grids. 

Figure  4  Counter-example  for  relations  between  2-D  medians  and  openings-closings. 
(•  €  y,  0  6  Yc.) 


38 


FIGURE  1 


FIGURE  2 


r> 


ORIGINAL  FUNCTION  OPEN  -  CLOSING 


FIGURE  3 


O  o  o 

•  o  o 

•  o  • 

•  o  o 

o  o  o 

Y 

o  o  o 

•  O  O 

•  •  • 

•  o  o 

o  o  o 

YH 


FIGURE  4 


